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Introduction 
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CTW ' 


seek  the  solution  vector  x in  Hilbert  space  H for 


the  linear  system  Ax  » y^  , where  y^  € H is  given  in  advanc^  and  A 
is  a bounded  linear  invertible  operator  on  H.  We  shall  conq>are 
convergence  of  two-part  splittings  (l.e.,  linear  stationary  methods 
of  first  degree)  with  convergence  of  three-part  splittings  (i.e., 
linear  stationary  methods  of  second  degree).  In  fact,  we  write  the 
two-part  and  three-part  splittings  of  A as  follows: 


+ ^2* 


and  A ■ Ai  + A9  + Ao, 


(1.1a) 

(1.1b) 


where  A^,  A2*»  A2  and  A are  all  l^ounded  linear  operators  on  H and 
A^  is  presumed  easy  to  compute  (for  example,  if  H is  finite- 


dimensional, then  Aj^  might  be  represented  by  a diagonal  matrix).  We 
are  now  ready  to  define  the  respectively  induced  two-part  and  three- 
part  sequences,  (X|^'}  and  (xj^}. 


Definition  1.1.  Given  A ■ Aj^  + A2'  where  A2'  “ A2  + A|j,  with 
fixed  y^  € H,  Then  for  any  " *0'  ^ two-part  sequence 


C*Q»^1  »*2  ******k  ****^ 
is  defined  iteratively  by 
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I ' H\+2  ^2*^+1  + ^3*^^  “ Xo  » ^ " 0»1.2,...  (1.2b) 

I 

► 

y 

Note  that  if  either  the  two-part  sequence  or  the  three- 

part  sequence  (x^^J  converges,  then  since  A is  invertible,  convergence 
is  necessarily  to  the  solution  vector  x where  Ax  ■ y^.  >We  shall 
comment  on  the  case  where  A is  singular,  at  the  end  of  this  paper. 

Now  if  A is  a non-singular  matrix  on  finite -dimensional  H,  then 
consider  A may  be  deconposed  as 

A - D + E + F, 

where  0 is  the  diagonal  part  of  A,  E is  the  (lower  triangular)  matrix 
whose  entries  match  those  of  A below  the  main  diagonal  and  F is  the  I 

corresponding  upper  triangular  matrix  taken  from  the  entries  of  A j 

above  the  main  diagonal.  The  two-part  splitting  (1.1a)  then  yields 
the  well-known  schemes 

(a)  Choosing  Aj^  " D»  we  have  the  Jacobi  iteration  scheme, 

(b)  Choosing  A,  - D + E,  we  have  the  Gauss-Seidel  iteration  ■ 

I 

scheme,  (1.2c) 

(c)  Choosing  Aj^  - ^ + E , with  0 < uu  < 2 , we  have 
the  successive  overrelaxation  (SOR)  method. 

Three-part  splittings  are  given  mention  in  [7]  and  [9].  Also,  in  a 

I 

P®P®x  of  J.  D.  P.  Donnelly,  a theorem  on  chaotic  relaxation  is  proven 
Theorem  2.1).  This  result  is  recaptured  (and  generalized)  in  the 
setting  of  three-part  splittings,  cf.  [2,  Theorem  5.4].  I 


^l*k+l  “ yo  » " 0,1,2,...  (1.2a) 

The  three-part  sequence  is  defined  iteratively  by 


i. 


How  are  the  two-part  and  three-part  splittings  related?  Observe 
that  (1.2b)  is  equivalent  to 


*k+2 

L*k+lJ 

t 

'k+1 


»i'^A2 


-At  Ao  A^ 
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(1.3) 


where  Xj^  -»  x in  H if  and  only  if  Zj^  -»  Z - in  H ® H.  Moreover, 
since  (1.3)  is  the  result  of  a two-part  splitting  on  H ® H, 


(Z,^  - Z)  - B2*"(Z^  - Z). 


(1.4) 


Compare  (1.4)  to  the  condition  resulting  from  the  two-part  splitting 
(1.1a),  viz., 

(x,^'  - x)  - B^(k^  - x),  B - -A’^A2*.  (1.5) 

In  other  words,  as  B " ~4^'A2  is  the  transition  (or  iteration) 
operator  for  the  two-part  splitting  (1.1a),  so  is  B2  (given  in  (1.3)) 
the  transition  matrix  operator  Induced  by  the  three-part  splitting 
(1.1b).  The  Importance  of  these  remarks  is  that  a sufficient  condi- 

')  of  (1.2a)  or  (xj^}  of 
(1.2b)  is  that  the  spectral  radius  of  the  respective  transition  oper- 
ators p(B),  and  p(B2)»  be  less  one  (this  condition  is  necessary  for 
finite-dimensional  H).  We  are  ready  for  the  following  definition: 


tion  for  the  convergence  of  sequences  (x^ 


'}  of  (1.2a)  and  (xj^}  of 
(1.2b),  then  their  respective  asymptotic  convergence  rates . and 
are  given  by 

R'  - -logj^Qp(B), 

R - -logj^Q  p(B2), 


Definition  1.2.  Given  the  sequences  (x^^ 


where  B ■ ■Ai”^A2‘  from  (l.Ia)  and  B2  is  given  in  (1.3), 


Remark.  We  indicate  base  ten  in  the  definition  above  only  as  a 
convenience  since  1/R  will  then  indicate,  roughly,  the  number  of 
iterations  or  "hits"  which  will  produce  one  more  decimal  place  of 
accuracy  (cf.  [8,  page  63]). 


We  conclude  this  section  with  an  explicit  statement  of  the  goals 


of  this  paper.  Given  Aj^Xj^^2  A£*k+1  ^3^  " ^o  Aj^  fixed 

(and  presumed  easy  to  invert) . Then  we  seek  to 


Explicitly  construct  (and  hence,  A2). 

(Theorem  2.1,  display  (2.2),  Hypothesis  3). 

Explicitly  compute  p(B2)>  and  to 

Compare  with  p(B)  (noting  that  A ■ Aj^  + A2'  ■ Aj^(I-B)) 
(Theorem  3.1,  display  (3.4)  if  p(B)  is  real;  Theorem 
3.3  if  p(B)  is  imaginary.) 


Thus,  if  for  a fixed  two-part  splitting  A " Aj^  + A2',  we  can  define 
that  A3  in  the  three-part  splitting  A - Aj^  + A2  + A3  where  p(B2)  < 1 
and  p(B2)  < p(B),  then  we  will  have  established  che  greater  conver- 
gence rate  of  (xj^)  in  (1.2b)  over  that  of  in  (1.2a). 


2.  Relating  o(B)  and  0(62)  via  analytic  0. 


ecall  that  we  are  attempting  to  compare  the  spectral 


radius  p(B)  of  iteration  operator  B (see  1.5))  with  the  spectral  radius 
p(B2>  of  the  iteration  matrix  operator  B2  (see  (1.3),  (1.4)).  In  the 
following  theorem,  we  assume  that  some  bounds  on  o(B),  the  spectrum 
of  B,  are  known  (Theorem  2.1,  Hypothesis  1).  Then,  A3  is  explicitly 


constructed  as  a certain  analytic  operator  function  of  B (Hypothesis 
3).  This  automatically  fixes  A2  and  hence,  defines  B2  In  (1.3).  The 
theorem  characterizes  a(B2)  In  terms  of  o(B) , depending  on  the  analy- 
tic 0(*)  chosen  (cf.  (2.3)). 

Theorem  2.1  ([4,  Th.  3.1]).  Given  Invertible  A » Aj^  + (A2  + A^) 
where  -B  ■ Aj^’^(A2  + A^).  Suppose 

1.  o(~B)  lies  Inside  the  cardlold  (cf.  Figure  1) 

> 

e - (2E(1  + Re(Z))  - 1:  •?  - e^®)  . (2.1) 

2.  0(*)  Is  a complex  analtylc  function  whose  domain  of  defini- 
tion contains  o(-B),  and  does  not  assume  the  value  -1  on 
d(-B). 

3. 

A3  - (2.2) 

where  0(-B)  Is  the  corresponding  analytic  opera tor -valued 
fxinctlon  of  -B,  and  1 Is  the  Identity  operator.  Then  with 
B2  given  in  (1.3), 

-»(B3>  - o(0(B))  u 0 ( ^ ) . (2.3) 

Proof.  Use  0(-B)  to  define  U,V  and  A^  as  follows: 


U - 0(-B) 


A3  - Aj^UV  . 


Then  verify  the  Identity 


B - U + V + UV 


6. 


Note  that  from  (1.3), 


»2  - 


u-w  uv 

-I  0 


Let  W - 
has  form 


I -V 
0 IJ 


.-1 


so  that  W B2W  (which  has  the  same  spectrum  as  B2) 


W"^B2W  - 


U 0 
L-i  VJ 


.-1 


• o(B2>  - 0(w  *B2W)  » o(U)  U a(V) 


The  conclusion  now  follows,  and  the  proof  is  done. 


Remark.  Why  does  the  cardiod  C-  (Figure  1)  enter  into  the  theorem 
in  (2.1)?  The  reason  is  that  we  require  that  p(B2)  <1  so  as  to 
guarantee  convergence.  It  is  shown  in  [2,  pg.  335]  that  it  is  Just 
this  condition,  p(B2)  < 1,  that  implies  o(-B)  is  a subset  of  the 
interior  of  cardioid  in  the  special  case  where  0(*)  is  a constant, 
however,  bounding  o(~B)  by  C-  is  too  crude.  In  fact,  we  note  that  for 
constant  0(Z)  * s 7^  -1,  we  have 

p(B2)  < 1 ^ CJ(-B)  6 £Z:lZ-l|  < 2}  , (2.4) 

the  proof  of  which  is  in  [4,  Prop.  3.3]. 


3.  The  case  0(Z)  is  constant. 


fixed  complexes  and  all  complex  Z.  In  operator  terms,  0(B)  ■ si,  for 
all  operators  B on  H.  One  immediate  simplication  is  that  is  easy 


f » 

\ I 


to  compute,  given  the  representation  A " with  A^  defined 

in  (2.2)  as  Hypothesis  3 of  Theorem  2.1.  In  fact,  equation  (1.2b) 
for  the  three*part  splitting  (using  (2.2)  with  0(Z)  ■ s)  reduces  to 


*k+2  “ '^1*^^  { *k+i  *k) 


(3.1) 


-1 


+ ((l-s)xj^+l  + sxj^)  + Ai  , 

where  conq>lex  s>^-l,A*A]^+A2+A2"  Aj^(I-B)  ■ Aj^  + A2 


I * 


Remark.  If  complex  s is  chosen  to  be  zero,  then  (3.1),  the  equiva- 
lent to  the  three-part  expression  (1.2b),  reduces  to  the  two-part 
splitting  (1.2a). 

We  give  an  analysis  of  three-part  convergence  versus  two-part 
convergence  for  A * A^(l-B)  in  the  following  two  case  of  the 
iteration  operator  B,  viz.,  when  the  spectrum  of  B,  9(B),  is  real, 
and  when  it  is  pure  imaginary. 

3.1  Case  (A);  A ■ A]^(I-B).  o(B)  is  real  (0(Z)  ■ s ■ constant). 

e have  already  noted  that  if  p(B2)  < 1,  for  B2  given 

in  (1.3),  then,  necessarily,  9(-B)  is  a subset  of  the  interior  of 
cardlold  C of  (2.1),  and  if  analytic  0 is  constant,  then  9(-B)  is  a 
8\ibset  of  the  open  disc  in  the  conqilex  plane  centered  at  real  1,  having 
radius  2 (cf.  (2.4)).  If,  moreover,  9(B)  is  real,  then  this  reduces 
to  the  condition  that  there  exists  real  a,  /S  € 9(-B)  such  that  for 
all  \ € 9(-B),  -l<a<  i<4<3.  The  next  theorem  responds  to  the 
following: 


1)  What  Is  the  optimal  real  s,  call  it  we  may  assign 
to  0(-B)  ■ si  so  as  to  give  optimal  p(B2>,  the  minimal 
spectral  radius  of  B2  of  (1.3)?  Note  that  B2  depends  on 
the  choice  of  A3  from  (1.3),  and  A3,  in  turn,  depends  on 
0(-B)  " si  from  (2.2). 

2)  Given  optimal  s^,  what  is  the  explicit  value  of  the 
optimal,  or  minimal  p(B2)  as  a function  of  the  spectral 
radius  p(B)? 

> 

Here  is  that  theorem  now. 

Theorem  3.1.  Given  A - Aj^(l-B),  o(B)  real  (where  Aj^"^  is  easy  to 
compute).  Suppose  6 o(-B)  where  fore  all  \ € o(-B), 

-l<aiXij8<3.  (3.2) 

Let  m denote  the  midpoint  of  o(-B),  i.e.. 


m 


V. 


By  setting  0(-B)  ■ s^I  in  (2.2),  we  construct  that  B2  in  (1.3)  whose 
spectral  radius  is  minimal  relative  to  all  0(-B)  * si,  as  s varies 
over  all  real  s. 

Moreover,  in  all  four  cases  in  the  table,  above,  three-part 
convergence  is  better  than  two-part  convergence  in  the  sense  that 


P(B2)  < p(B),  or 
R > R'  (cf.  Def.  1.2). 


(3.5) 


On  the  proof  of  Theorem  3.1.  Complete  details  appear  in  [4,  section 
5].  The  proof  depends  on  several  technical  lemmas  whose  end  objec- 
tive is  to  establish  that  p(B2)  * £ g»  Che  maximum  of  a pair  of 
functions  f and  g,  each  defined  for  real  s (recall  that  0(-B)  * si) . 
The  optimal  (smallest)  value  of  p(B2)»  which  we  denote  P^(B2)f  is 
computed  as  the  minimum  of  f v g.  These  are  the  values  given  for 
Po(B2)  in  the  table  above.! 


Remark.  Observe  that  in  case  the  midpoint  m < 0,  then  it  is  automatic 
that  p(B)  < 1 , so  that  in  the  table  (3.4),  the  expression  VI  - P(B) 
is  always  well  defined.  Also,  when  m 7^  0,  we  produce  an  s^  where 
Po(B2)  in  all  four  categories  is  always  less  than  p(B).  This  is  easy 
to  confirm  directly  from  the  table  (3.4). 


Example  3.2.  Consider  the  3x3  matrix  A and  its  decompositions 

'1  0 1‘ 

A - 110 

.0  1 1. 


- V 


(SOR  decomposition) 


(3.6) 


■ 0 
I - -1 


(Jacobi  decomposition) 


lU. 


where  for  all  ui,  0 < uu  < 2,  the  SOR  iteration  matrix  (c£.  (1.2c)) 


given  by 


B - 


U) 


-uu 


w-1  0 

“lu(uj-l)  uu-1 

(«^(uu-l)  -u)((i)-l)  uj^+urt-1 


(3.7) 


Note  that  (3.6)  presents  two  two-part  splittings  for  A,  viz.,  the 
SOR  deconq>osltion  with  Iteration  matrix,  B ° and  the  point- Jacobi 
decomposition  with  Iteration  matrix  J.  Note  that  J Is  consistently 
ordered,  cyclic  of  Index  three  with  eigenvalues  equal  to  the  cube 


roots  of  -1.  Under  these  conditions,  we  may  use  o(J)  the  spectrum 
of  J,  to  find  ®(=^yj)»  the  spectrum  of  [8,  Theorem  4.3],  In  fact, 
let  u),  0 < uu  < 2 define  In  (3.7).  Let  J be  given  as  In  (3.6). 

1 Then 

I 

I for  all  X € o(J),  we  have  ^ 6 o(id  ) If  and  only  if 

t 

(X  + uu  - 1)^  + X^uu^  - 0 . (3.8) 

Let  us  select 

uu  - uu^  - 0.897107  (3.9) 

which,  from  (3.8)  yields  the  spectrum  of  the  SOR  Iteration  matrix 

tC^  , l.e.,  for  uu^  = 0.897107, 
o 

) - C-0. 026473,  0.211778,  0.211791], 


so  that  the  hypotheses  (3.2)  and  (3.3)  of  Theorem  3.1  write  themselves 
as  follows: 


From  this,  Che  SOR  convergence  race  for  Che  Cwo-parC  spllccing  of 


(3.6)  is 


R*  - -logio(p(«^u,^))  « 0.674, 


(3.11) 


NoCe.  By  crlal  and  error,  ic  seems  che  of  (3.9)  Is  opclmal, 
i.e.,  produces  Che  smallesc  p(a£yy).  In  any  case,  Che  face  chaC  Che 
mldpoinC  m of  (3.10)  is  noc  zero,  guaranCees  ChaC  improved  convergence 

muse  resulc  in  passing  Co  che  chree-parc  spliccing.  In  parcicular, 

2 ^ 
from  (3.10)  m < -a  and  m > 0.  Frexn  (3.4)  in  Theorem  3.1,  we  see 

Chac  opcimal  s^  is 

- m « 0.092659, 

while  opCimal  (smallesc)  specCral  radius  p(B2)  is 


0(»2>  * 


which  defines  che  Chree-parC  convergence  race 


R - -logj^o^P(®2^^  “ 


(3.12) 


(compare  wichC3.11)). 

Finally,  noCe  chac  Che  Chree-parc  convergence  race  (3.12)  pre> 
dices  (asympCoCically)  1/R  w 1 iceracion  for  each  decimal  place  of 
accuracy,  while  che  Cwo-parC  SOR  rare  r'  of  (3.11)  predieCs  1/r'  1.5 

iceracions  per  addicional  decimal  place  of  accuracy.  We  found  in 
acCual  numerical  examples  wich  various  values  of  y^  for  Ax  * y^, 
and  for  various  inicial  veccors  x^,  chac  Chese  asympCoCi.c  convergence 
races  manifesCed  Chemselves  afCer  only  seven  or  eighc  iCeracions. 


1 

1 

i 


i '■ 


I 


1 1 


splitting  A * + A£  " A(I-B),  whose  iteration  operator  B had  an 

unbalanced  spectrum  about  the  origin  (m  ^ 0)  would  always  yield  to 
improvement  convergence  rate  by  passing  to  the  three-part  splitting 
(Theorem  3.1).  This  section  considers  the  case  when  o(B)  is  on  the 
imaginary  axis  which  proves  to  be  far  simpler  than  the  real  case. 
First,  observe  that  since  analytic  0(Z)  = s is  constant,  a(B),  the 
spectrum  of  B lies  inside  the  circle  of  radius  two,  centered  at  real 
1 (cf.  (2.4)).  This  means  that  all  \ in  for  a(B)  imaginary,  we  have 
|\|  < v'J.  The  Imaginary  a(B)  proves  simpler  than  the  real  o(B) 
because  whenever  p(B)  < (so  that  the  two  part  sequence 
diverge),  the  three-part  splitting  will  always  produce  a convergent 
sequence  Moreover,  no  restrictions  on  the  imaginary  midpoint 

apply.  The  following  theorem  states  the  details  for  passing  to  the 
optimal  three-part  splitting  (1.2b)  via  construction  of  A^  as  per 
(2.2)  for  specifically  defined  constant  0(-B)  si. 


Theorem  3.3.  Given  A ■ Aj^(I-B),  o(B)  imaginary  (where  Aj^”^  is  easy 
to  compute).  Suppose  p(B)  < JS,  Then 

case  (a);  If  3^-  - ^ p(B)^  < 3 (0.786  ^ p(B)  < 1.732)  then 
the  optimal  s - s^  is  the  unique  real  solution  in  (-p(B),p(B))  to 
the  polynomial 

•o*  + ® • (0  ‘ l»ol  *= 


I 


[ 


i 


I 


Moreover,  the  opcimal  (smallest)  p(B2)  is  then  given  by 
P^®2^optimal  “ l®ol  * 

case  (b);  If  0 < p(B)^  ^ ^-2  ^ (0  < p(B)  s 0.786),  then  the 

optimal  s " s^  is  given  by 

Sq  “ P(B)^» 

in  which  case  the  optimal  p(B2)  is  given  by 
optimal  " 

For  case  (a)  and  case  (b)  above, 

p(B2)  < 1,  and  p(B2)  < p (B) . 

On  the  proof  of  Theorem  3.3.  The  complete  proof  requires  the  struc- 
ture theorem  of  three-part  splittings  for  constant  0(Z)  " s [4, 
Theorem  4.2],  which  we  do  not  present  here.  ■ 

Remark.  Observe  from  the  statement  of  Theorem  3.3,  case  (a),  that 

even  if  A ■ A2^(I  - B) , where  p(B)  is  near  to  unity  (so  that 

converges  slowly,  if  at  all),  then  the  three-part  splitting  guarantees 

4 3 

a p(B2)  very  near  to  s^  where  s^  + 2s^  - 1 - 0,  i.e.,  p(B2) 

0.7167  (so  that  (x^}  converges).  That  is,  although  the  two-part 
convergence  rate  R'  * logj^Q(p(B))  « 0,  we  have  the  three-part 
convergence  rate  R = -logj^Q(p(B2))  » 0.14.  This  fact  holds  regard- 
less of  the  size  of  the  system.  To  illustrate,  consider  the 
following  example. 


Example  3.4 


The  class  ^ o£  n x n matrices,  n varies,  is  defined  by 
Ct  " (A(n):n  * 1,2,3,...}  where  each  A(n)  is  the 
tridiagonal  n x n matrix 


A(n)  - 


2 1 0 
-12  1 
-1  2*. 

*.  -.1 

0 -12 


2ln(VB(n))  • 


Accordingly,  the  n x n skew -symmetric  iteration  noatrix  B(n)  for  the 
two-part  splitting  A(n)  - 21^^  + A2'  ■ - B(n))  is 


B(n)  - 


0 

1 0 -1 

1 0 *‘- 
• •.  -1 
0 •.  • 

1 0 


Now  the  n-element.  Imaginary  spectrum  a(B(n)),  which  depends  on  n,  is 


a(B(n))  - |i  cos  ( : k - l,2,...n| 


so  that 


p(B(n))  - cos(|j-^-j)  t 1 as  n t • . 


(See  [1,  page  380,  Ex.  8,  9]  for  a related  example.) 

Now  for  n a 4,  case  (a)  of  Theorem  (3.3)  applies.  That  is, 
supponse  A(n)x  ■ y^.  Then  as  n -»  •,  the  three-part  splitting  will 
produce  a convergent  sequence  which  eventually  has  every  seventh 

term  (I/R  m 7)  yielding  one  more  decimal  place  of  accuracy,  while  the 


r 


two-part  sequence  (xj^')  (given  skew -sy  nine  trie  iteration  matrix  B(n)) 
becomes  slower  and  slower  in  its  convergence. 

Actual  computations  reveal  that  even  when  n is  large,  the  asymp- 
totic convergence  rate  prevails  after  only  about  a dozen  iterations. 


4.  Some  open  questions 


ecall  that  our  investigation  of  three-part  splittings 


(1.1b)  for  Invertible  operator  A on  H relied  on  the  imbedding  (1.3) 
as  a two-part  splitting  on  the  larger  space  H © H;  for  this  reason, 
convergence  rate  analysis  of  (x^}  versus  that  of  (x^'}  (cf.  Def.  1.1) 
is  effected  by  comparing  the  spectral  radius  of  B2  of  (1.3)  with  that 
of  B in  (1.5) . 

Given  fixed  iteration  operator  B for  A " Aj^(l-B)  (equivalently, 
invertible  A^  is  fixed)  therefore,  we  constructed  B2  by  first 
analytically  defining  0(B)  which,  in  turn,  fixes  A^  (cf.  (2.2)  of 
Theorem  2.1),  and  hence,  also  fixes  A2  in  the  expression  A * Aj^  + 


+ A^* 


This  paper  proceeds  under  two  restrictions,  namely  that  the 
analytic  function  0 is  a constant  s (in  operator  terms,  0B  5 si), 
and  that  the  operators  A * A^^  + A2'  nnd  A^  are  both  invertible; 
is  supposedly  easy  to  compute.  Some  work  has  been  done  in  each  of 
these  areas  where  these  two  restrictions  are  relaxed.  We  briefly 
mention  these  results,  while  indicating  paths  of  further  exploration. 


When  analytic  0(«)  is  not  constant.  In  [2,  p.  336),  linear 


In  [3],  non-constant  0 is  also  studied.  The  main  difficulty  is 
in  the  computation  of  Aj  in  (2.2)  which  involves  the  inverse  of 
(0(-B)  +1);  in  [2],  this  entails  the  computation  of  (-pj^B  + 

(P2  + 1)1)'^  which  may  be  as  difficult  as  the  computation  for 
the  inverse  of  the  original  operator  A.  (Of  course,  in  the  present 
paper,  where  0(B)  = si,  then  (0(-B)  + 1)“^  is  just  the  scaler  operator 
(s  + 1)”^I.  Hence  the  questions: 


4.1  Given  the  operator  A.  and  the  invertible  component  Aj^  (so 
that  A " Aj^  -f  Ao*).  and  given  the  explicit  construction  of 
Ao  for  analytic  0 in  (2.2),  what  is  the  convergence  rate  of 


the  three-part  sequence  Cx^^)  defined  by  A ■ Aj^  + A2  + Aj. 
compared  to  that  of  the  two-part  sequence  (x,  '}  defined  b\ 


A * Aj^  A2'  (necessarily.  A^*  ” Aq  + A. 
0 is  not  constant? 


when  analytic 


4.2  Moreover,  under  what  circumstances,  or  for  which  0.  are  the 
operator  terms  Ao  and  Aj  easy  to  compute?  (More  exactly, 

since  from  (1.2b),  ^^^2  * ”^1  ^2^St+l  ” ^1  ^ ^1  ^o* 
we  require  easy  computation  only  of  the  operator  products 
A2^"^A2»  and,  of  course,  Aj^"^. 


When  A is  not  invertible.  In  a paper  of  Michael  Neumann  [6],  three- 
part  splittings  are  studied  for  non- invertible  operators  on  finite- 
dimensional Hilbert  space  H,  i.e.,  for  rectangular  matrices  A.  Given 
that  A is  m X n matrix  (an  operator  sending  n-space  to  m-space  by 
left-hand  multiplication  on  the  columns),  and  given  y^  in  m-space,  we 
are  to  find  x in  n-space  such  that  Ax  ■ y^.  Either  a solution  vector 
X exists,  or  else  the  system  is  not  solvable,  i.e.,  an  approximate  or 
best  solution  may  be  obtained.  In  the  second  instance,  Neumann  writes 


A - Aj^  + Aj' 

where  the  splitting  is  subproper . i.e,, 

rg(A)  c rg(Aj^)  and  n(A)  = n(Aj^) , 

where  rg(*)  and  n(*)  indicate  range  and  nullspace,  respectively.  If 
equality  obtains,  the  splitting  is  proper.  The  idea  then  is  to 
coiiq>ose  the  iteration  matrix 

B - -A^‘*A2' 

where  Aj^"*"  is  the  Moore-Penrose  generalized  inverse  of  Aj^.  Thus,  a 
counterpart  to  matrix  B2  of  (1.3)  is  possible.  Under  these  more 
general  conditions,  Neumann  considers  two  cases,  viz.,  when  A^^A2* 
is  or  is  not  weakly  convergent  (Aj^'^A2 ' is  weakly  convergent  means 
the  splitting  A - Aj^  + A2'  is  subproper,  X 6 (Aj^‘*A2')  =»  |X|  x 1,  and 

the  Jordan  blocks  corresponding  to  X - 1 are  of  order  one). 

(^1  C6].  -B  “ Aj^"^^2'  weakly  convergent:  the  constraint 

here  is  that  o(-B)  c u (-1),  where  cP  is  the  interior  of  the 

cardloid  CJ  of  (2.1). 

Case  (b)  -B  - Aj^'^A2'  is  weakly  convergent.  Then  it  is  further 
assumed  that  o(-B)  c (Z:Re(Z)  ^ 0)  U (-1). 

Among  many  other  things,  Newmann  exhibits  certain  analytic  0 
which  effect  A^  in  the  construction  of  the  generalized  three<*part 
splitting 


A ■ Aj^  + A2  A^. 


The  question  is  raised,  therefore 


4.3  Can  specificially  computed  convergence  rates  be  given 

for  non-invertible  matrices  A under  a three-part  splittinii 
relative  to  rates  under  a two-part  splitting? 


4.4  Can  the  results  of  Neumann  be  extended  to  the  operator 


cage  for  infinite -dimensional  Hilbert  space  H? 
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